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10. ARITHMETIC PROCESSOR PAGING 


10.1 Introduction 


BBN has implemented a device called the BBN Pager which is 
connected between the KA1@ (PDP-19 arithmetic processor) 
and the KA1@'s memory port. In conjunction with a set of 
hardware modifications to the KA1%, the BBN Pager changes 
the core memory mapping mechanism such that core memory 

is allocated and protected in 512 word pages. The address 
space of the machine is mapped for EXEC mode as well as 
USER mode with the BBN Pager. The paging mechanism can be 
bypassed by executing a specific CONO to the pager or by 
executing (or depressing) IOB reset to invoke a so called 
"transparent mode" for the running of the standard DEC 
monitors or diagnostic software. 


10.2 The Associative Mapping Process 


When mapping is enabled in the pager, the 9 high order 
virtual address bits, state of the EXEC/USER mode flip 
flop, and type of request (read, write, execute) from the 
KA1@ are compared and tested with the contents of 1 to 54 
(depends on pager configuration) associative registers. 
This comparison is performed on all associative registers 
simultaneously. If a match is found, the particular as-~ 
sociative register containing the match also contains 

11 bits which become the high order 11 bits of the real 
core address (hereafter abbreviated as R.C.A.).** ‘The use 
of 11 R.C.A. high order bits permits the KA1Q 

to reference up to 1024K* words of memory. In this simple 
case, the overall delay directly attributed to the pager 
is about 100 nanoseconds plus cable delay. The simple case 
is represented by Figure 10-1. 


*K=1020 words 


** A glossary of terms is presented at the end of this section 
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From KA1@ Inside BBN Pager To Memory (When 
a match is found) 


These three levels are 
used when a trap con- 
dition arises, but not 
in the association 

process itself. 


Priority Inter- 
rupt Cycle 


Key Cycle (When 
Examine or 
Deposit Switch 
is pushed on 
computer 
console) 


Indirect Address 
Fetch 


Read Level(R) 
Write Level(W) 
Execute Level(E) 


These levels are 
tested against the 
permission bits in 
each Associative 

Register 


Read Level(RtE) 
Write Level(W) 


EXEC/USER Mode 
These levels are tested 
for equivalence with the 


9 Highest Bits 11 Highest Bits 


of 18 Bit corresponding bits in of Absolute 
Address each Associative Register. Address 

9 Lowest Bits 9 Lowest Bits 
of 18 Bit of Absolute 
Address Address 


Bits in Associative Registers 
Virtual Page 1) 21uloaul2 Absolute Page Number 
Number--—-9 Bits 11 Bits 


Execute Permission (EP) 
Write Permission (WP) 
Read Permission (RP) 
USER Mode (% for EXEC Mode) 


Figure 10-1 
Mapping From Virtual to Absolute Addresses 
(Simplest Case, Match Found in Associative Register) 
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10.3 USER Mode Mapping when the Association Fails 


When a match is not found in an associative register (hereafter 
abbreviated as A.R.), the pager begins a self-loading sequence 
which basically involves the loading of an A.R. from infor- 
mation found in one or more tables in core memory. The 
particular A.R. to get self-loaded is determined in a very 
simple cyclic fashion. That is, if the last A.R. loaded was 
A.R. 5, the next to be loaded will be A.R. 6(if it exists; 

if not, the next existing A.R. in the cyclic sequence is used) 
eee The average pager is configured with 16 A.R.'s which 
means that if the program confines most of its references to 
an 8K or less working set, self-loading will be invoked 
infrequently. 


The first stage of the self-loading sequence involves reading 
some information from a table in core memory called the page 
table (hereafter abbreviated as P.T.). This table is 512 
words long and is itself a page which may be anywhere in core 
memory. The origin of the P.T. is specified by the contents 
of a register in the pager called the User Mode Base Register 
(hereafter abbreviated as U.B.R.). The 11 bits of the U.B.R. 
are used as the 11 high order address bits and are concaten~ 
ated with the original 9 high order address bits (on which the 
association failed) to reference the appropriate word in the 
Pols 


The word which is read from the page table is of one of four 
types as determined by bits @ and 1 of the word. These types 
are: 

QZ private page 

G1 shared page pointer 

1g indirect page pointer 

11 illegal format 


10.3.1 Private Page 


In the simplest case of a private page type, the rightmost 11 
bits contain the high order R.C.A. bits and bits 2-4 contain 
the read, write, execute access information which are used to 
self~load an associative register. The private page entry 
has many options which are detailed in Figure 10-2, 
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Entry type code §%, Private Page 


Read 
Write Access Permitted to Page 
Execute 


Directed Traps and Loading Information 


Location of this page-- 
22 bits 


| —_——— permission bit 
i i ee to Monitor--ll=trap immediately 


1g=trap after loading A.R. 
Gl=and @M = don't trap 


Trap on write or read- 
/ —— ee MOdify-write reference 
(useful to make private 
i copy of a page) 


L____---T'rap to User bit 


ee ee eet ne A ES ES LT ET ET TT At 


*not used by Pager hardware 

Figure 10-2, Private Page Entry in P.T. 
Most of the option bits cause traps to occur which cause 
the KA1@ to take some special action when a page is 
referenced in a particular way. 
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10.3.1.1 The Location Field 


The location field is 22 bits wide. This permits the speci- 
fication of where a page really is in primary, secondary, or 
even tertiary storage. If bits 14-17 are all @'s, the right 
most 11 bits contain the high order R.C.A. bits. If any of 

bits 14-17 are set, a page not-in-core trap will be invoked 

which will cause the KA1% to take special action. 


10.3.1.2 Limiting the Size of the User Address Space 


The pager contains a register called the Address Limit Reg- 
ister (A.L.R.) which is capable of restricting the legal 
USER mode virtual addresses to the first 16K, 32K, 48K, 

64K, 80K, 96K, 112K or the entire 256K, 


10.3.2 The Core Status Table 


Whenever an associative register is successfully loaded, a 
word in the core memory status table is updated. This table 
contains an entry for every page of real core in the system. 
An entry contains information about that page related to: 
the relative amount of time the page has been in core (con- 
tained in a 9 bit pager register called A.G.E.R.--AGE Reg- 
ister), whether the page has been written into (the modification 
bit), and which processes (of a subset of all processes 
existing in the system) have referenced the page. The par- 
ticular processes referencing a page are identified bv bits 
in the process use field of the entry. These bits are 
updated by the contents of a 26 bit pager register called 
P.U.R.--Process Use Register. 


The use of the core status table (C.S.T.) causes one additional 
read-modify-write cycle of overhead (while referencing the 
C.S.T.) in the self-loading sequence. 


The modification bit and write permission bits at the A.R. are 
handled in a slightly complicated way. The modification bit 
is set only if the memory request which initiated the loading 
of an A.R. was a write or read-modify-write cycle. The mod- 
ification bit is never cleared by the pager. If an A.R. is 
loaded due to a non-write request, the write permission bit 

of the A.R. is not set regardless of whether writes are per- 
mitted by the page table entry unless the page has already 
been modified (indicated by the modification bit already set 
from some previous operation) and write permission is specified 
by the page table entry. 
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A.R. write permit + PT write permit A (WRRQ V modification bit) 
new modification bit + 01d modification V (WRRQ A PT write permit) 


As special aid for the control of shared pages, a pager trap 

is generated if the three high order bits of the page age field 
in the C.S.T. entry are all @'s. This provides a way for the 
core manager to defer use of a particular real core page while 
the page's state is being tested or changed. 


The core status table starts at absolute real core location 
48G0.. A diagram of the table and its use by the pager is 
shown in Figure 10-3. 
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Absolute Core Location 
(Start of Table) 


4000, 
CORE STATUS 
TABLE 
Dispatched into by ONE . 
7 


Number 


Real Core Page 
AVA AVACL 


y, a 

Absolute Core 

Location fo * 

10000 (highest Se 

address to which 

table can extend if 1024K real memory is used) ae 
7 

/ Core Status Table Entry .«~ 
0 8 9 10 35 


9 Bits 26 
page age process use bits 


modification bit 


AGER PUR 
Register Register 


1. Bits 9 - 8 of AGER replace Bits g - 8 of CST entry. 


2. Bits 19 - 35 are "ORed" into Bits 1% - 35 of csp 
entry. 


3. Write request level is "ORed" into Bit 9 of the 
CST entry (if the write is permitted). 
Figure 17-3 


Pager References to the Core Status Table 
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10.3.3 Shared Page Pointer 


The Shared Page Pointer entry in the P.T. is used for the 
most commonly shared pages in the system. This type of 
entry is detailed in Figure 10-4. 


Entry Code @1, Shared Page Pointer 


Shared Page Unused * 


Number 13 bits 


- Access permission bit 


A.R. 


Trap on write or read-= 
modify-write reference 
(useful to make private 
copy of a page) 


Trap to User bit 


Figure 10-4 Shared Page Pointer 


The Shared Page Number/field is used as a dispatch into the 
Special Pages Table (S.P.T.) which starts at absolute core 


Trap to Monitor- -ll=trap immediately 
1g=trap after loading 


Jl=and GM = don't trap 


location 29,89%,. The contents of the specified S.P.T. entry 


contains the page location information in bits 14-35 in the 


same format as a private P.T. entry bits 14-35. (see section 


Bio ae ro loa Cop 
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10.3.4 Indirect Page Pointer 


The Indirect Page Pointer entry in the P.T. is used for 
uncommonly shared files or processes or for indirectly 
referencing the dynamic address space of a file or process 
which is expected to change. This type of entry is de- 
tailed in Figure 10-5. 


Entry Code 19, Indirect Page Pointer 


Read 
Write 
) Execute 


Directed Traps and Loading Information 


(eg ron 13 14 26 27 35 


Page Table Number 
13 bits 


Page Number 
9 bits 


ae permission bit 


Trap to Monitor--ll=trap immediately 
1f=trap after loading 
A.R. 
Yl=and 9M = don't 
trap 
Trap on write or read- 
‘modify-write reference 
(useful to make private 
copy of a page) 


Trap to User bit 


Figure 10-5 Indirect Page Pointer 
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The Page Table Number (P.T.N.) is used as a dispatch into 
S.P.T. to fetch an entry which contains the location in 
bits 14-35 (see section 10.3.1.1) of the indirect page 
table. The Page Number Field of the Indirect Page Pointer 
is used as a dispatch into the Indirect Page Table. The 
specified entry of this table can be any of the three page 
table entry types just described. An attempt to use indi- 
rect page pointers to a depth of more than 2 will result 
in a pager trap. 


The access permission finally granted via Indirect Page 
Pointer mapping is the "AND" of the R,W,X bits and other 
access permissions starting with the first Indirect Page 
Pointer down through all P.T. entries until the destination 


page is found. This generally results in a reduction of 
the final access granted. 


10.3.5 Summary of P,T, Entry Types 


All three page table entry types have the virtue that the 
actual location of a page is kept in only one place instead 
of being replicated in many page tables (for example). 


Detailed examples of the three P.T. entries are presented 
in Figure 10-6. 


P.T. Indirect 
Location 


Page 
Location 


Indirect Page 


N 
Table 
Page Indirect Page 


Location 


Special Pages 
Table 


User Mode i 


Page Table 


on Shared Page 


Figure 19~6 


Private Page 


Private, Shared, and Indirect Mapping 
By the Paging Hardware 


oL eunr 2 


AUVLATYdOud Naa 


h-TT OT 
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10.4 EXEC Mode Mapping 


EXEC Mode mapping is really quite similar to USER Mode mapping. 
The major difference being that four distinct areas of the 

EXEC Mode address space are separately mapped and mapping of 
the "Resident Monitor" is separately enabled. These four areas 
are shown in Figure 10-7. 


Resident Monitor Code 
Mapping Optional 
(normally not invoked) 


32K | Mapped Individually 
per KA1# processor 


64K Swappable Monitor 
Code 


192K Mapped Privately 
per process 


256K 
Figure 10-7 Exec Mode Address Space 


The associative mapping process is exactly the same for EXEC 
mode as USER mode. However, most of the page table (for the 
self~loading sequence) for the EXEC mode address space is 
fixed in absolute addresses. Namely: 


Optional Resident Monitor Map 399B to 3877 2 
(Not used unless Resident 
Monitor Mapping is turned on) 
absolute 
First KA1#@#'s Map 319B. to 3177 Real Core 
locations 
Second KA1#'s Map 3799, to 37772 


Common Swappable Monitor Map 3299. to 35778 
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The area that 1s mapped privately per process is actually 
mapped by an area of the special overhead page associated 
with each process called the Process Storage Block (P.S.B.). 
The address of the P.S.B. is Specified by the contents of 

an 11 bit pager register called the Monitor Base Register 
(M.B.R.). Only the highest 128 words of the P.S.B. are useq 
for mapping purposes. The remainder is used for process 
specific temporary storage, stacks, and 2 more words are 
used by the pager. Thus locations 600, ~ 777, of the P.S.B, 
map the highest 64K of the EXEC mode atdress pace, 


EES 
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10.5 Invoking the USER Address Space With the KA1MY in EXEC Mode 


There are two classes of instruction modifications which were 
made to the KA1@ to enable the system to make references to 
parameters in the user's address space when the machine is in 
EXEC mode. 


10.5.1 UMOVEx 


The first class of instruction modifications is the UMOVEx 
set which forces MOVEs to and from USER space. 


UMOVE User Map Move 


7 9 12 33 2 17 18 35 


Move one word from the source to the destination specified by 
M, using the user address map. The source is unaffected, the 
original contents of the destination are lost. 


UMOVE User Move 100 
UMOVEI User Move Immediate 101 
UMOVEM User Move to Memory 102 
UMOVES User Move to Self 10:3 


These instructions provide a convenient way for the monitor 

to invoke the USER address mapping to fetch or store infor- 
mation into the USER address space (UMOVE or UMOVEM). UMOVETI 
provides a way for the monitor to do address computation 

using indirect addressing through the USER address space. 

Of course, indexing and AC references are not affected by the 
choice of USER map/EXEC map. However, addresses which indirect 
through the USER AC's are handled specially (see section 10.5.3). 


10.5.2 xXCT AC, E 

The next instruction change is a modification to the XCT 
instruction to use the AC Field (formerly ignored) to affect 
which map is used. 


The AC field is interpreted as shown in Figure 10-8. If the 
specified bit is on, use of USER address space is forced for 
any of the conditions indicated. 
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AC Field 


i 1g 4 2 a 


Effective Data Fetch, Address Data Store, 
Address | Byte Pointer Computation Byte 

Computation, Fetch, From Fetch/Store, 
Last Address Pop Stack, Byte Pointer Push Stack, 


of BLT Push Memory, 
"From’ of 


BLT 


Pop Memory, 
'To' of BLT 


9 1g 11 12 


Bit 
Figure 19-8 XCT AC bits 


The instruction to be executed is always fetched from monitor 


space. To BLT a data block from a user location specified in 
AC left, 


HRRI AC, FIRST 
xcT 4, [BLT ac, Last] 
FIRST: BLOCK N 

LAST = .~1 


To BLT a data block into a user region specified by the first 
and last user locations in AC left and right respectively, 


HRRM AC, INSTR 
HLR AC, AC 
HRLI AC, FIRST 
XCT 11, INSTR 


7 June 70 BBN PROPRIETARY 10-16-4 


INSTR: BLT AC, @ 

FIRST: BLOCK N 

XCT 15, INSTR can BLT data from one place to another in the 
user's address space. (Useful for zeroing out a region) 


To transfer a series of bytes specified by a user byte 
pointer in AC, 
LP: XCT 3, [ILDB ac2, ac] 
(or ({TpPB ac2, ac] ) 
UMOVEx AC, E is equivalent to xCT 15, [movEex AC, E| 6 
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10.5.3 Call From Monitor Flag (PC Flag Bit 7) 


Bit 7 of the PC flags word is used to store the state of a 
flip flop named CALL FROM MONITOR. This bit is saved and 
restored in the same fashion as the other PC flag bits. It 
is cleared by MR START, and set whenever an EX JSYS (ef~ 
fective address<1000) is executed in EXEC mode. This bit 
indicates to the called JSYS routine that effective addres- 
ses, byte pointers, and BLT pointers passed as arguments 
should refer to the EXEC mode address space, not the cur- 
rent USER address space. When this bit is on, special 

XCT and UMOVEX references are automatically forced into 
the EXEC mode address space instead of the USER's space. 


This feature simplifies the coding of EX JSYS routines 
which accept pointers as arguments and which may be called 
either from USER mode or EXEC mode. The routine merely 
makes use of any pointers with UMOVEx, or special XCT 
instructions, and the CALL FM MON flag automatically forces 
references into the correct address space. 
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10.5.4 Forced References to USER Space Locations 9-17, 


A 5 bit AC BASE REGISTER exists in the pager to provide an 

independent mapping mechanism for saved accumulators. This 
special mapping process to reference saved AC's is invoked 

by forced references to USER space (UMOVEX or special XCT) 

with addresses <20¢. 


During the mapping process, the low 4 bits are taken from 

the virtual address, the next 5 bits (27-31) are supplied 

from the AC BASE REGISTER, the top 9 bits (18-26) are 

forced to 775, and EXEC mode addressing is forced. This 
intermediate virtual address is then passed to the pager 

for mapping in the standard fashion. This means that the 
saved accumulators are mapped into one of 32 blocks, (selected 
by the AC BASE REGISTER) each 16 words long, located in 

page 775 of the EXEC mode virtual address space. (Recall 

this page is mapped privately per process). 


This space is ordinarily used as a stack of saved AC's. 
Upon entry to an EX JSYS which is pseudo-interruptable, 

the AC's are BLT'ed into this save region. The EX JSYS 
then references its own AC's in the normal fashion, and the 
AC's saved from the calling program via UMOVEX and XCT 
instructions with forced user space effective addresses 
<2%,. Pointers passed from the calling program which orig-~ 
inaPiy pointed into the AC's are evaluated with UMOVE or 
special XCT instructions, and automatically reference 

these saved AC's. This feature operates in the same— 
fashion whether the calling program was USER mode or EXEC 
mode, i.e. the CALL FM MON flag forces special references 
>20,g into the EXEC mode space, but special references <20. 
go into the saved AC stack independent of this flag. 


A side effect of this feature is that forced references 
<20, in USER mode reference the user's shadow core, (The 
rirgt 202 locations of the user's page zero). 


7 June 70 BBN PROPRIETARY 10-194 


19.6 Pager Traps 


A paging trap will occur whenever one of the following 
events happens: 


1. The trap bits in the process page table 
force a trap. 


2. The addressed page (or indirecting page 
table) is not in core. 


3. An illegal condition is detected, 


4, The Core Status Table entry for an ad- 
dressed page contains an age with the 
three highest bits = @. 


When one of the above conditions happens, the pager first 
stores the cause and location of the trap into the P.S.B. 

at location 571,. The format of this word is shown in 
Figure 19-9. TRen, if the APR operation in progress was 

a write, it stores the data into location 572, of the P.S.B. 
Finally, it forces the APR to execute absolute location 

789 (17%, if second APR). Location 7%, Should contain a 
x3¥s insfruction to a trap routine. 


The arrangement of the Trap Cause field was chosen so that 


decoding of the cause could be easily accomplished by the 
JFFO instruction. 


To restart a process which was terminated by a pager trap, 
the following information is of value: 


1. The program counter (PC) saved by the JSYS 
at location 7B is correct. 


2. If the read or execute bits in 57lg of the 
P.S.B. are set, restart is completed by 
performing a JRSTF @ through the PC word 
saved by the JSYS at location 7%, (179%Q). 


3. If the read bit is not set but the write 
bit is set in 571, of the P.S.B., the data 
in 572, of the P.S.B. must be written into 
the address in 571. of the P.S.B. before 
returning control Bo the process via JRSTF. 
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A sample program to restart a process whicn was terminated 
by a paging trap is given below: 


CONO PGR, @ ;LOAD PAGER WITH NEW BASE REGISTERS, 
ETC. (see section 10.7 for details) 
MOVE 1, 777571 3;GET TRAP STATUS WORD 
TLNE 1, 12 ;SKIP IF NEITHER READ NOR EXECUTE 
;BITS SET 
JRST BEGIN 
MOVE 777572 ;GET DATA WORD 
TLNE 1, 1 ;SKIP IF USER MODE 
JRST MONWR 
UMOVEM (1) ;COMPLETE USER MODE WRITE 
BEGIN: HRLZI 17, 777520 ;RESTORE AC's FOR THE PROCESS 
BLT 17, 17 
JRSTF @777573 3RESUME PROCESS (JSYS IN LOCATION 70, 
3SAVES THE FLAGS AND PC IN 777573). 
MONWR: MOVEM (1) 3; COMPLETE MONITOR MODE WRITE 
JRST BEGIN 


Figure 1f-1 shows that the PI cycle, Key Cycle, and Indirect 
Address Fetch levels are provided to the pager. The reason 
for the PI cycle and KEY cycle bits is to distinguish traps 

of the running program from PI and KEY cycle traps (KEY cycles 
occur when the console EXAMINE, DEPOSIT, or XCT switches are 
pushed). The Trap Status Word in Figure 19-9 contains suf- 
ficient information to simulate a KEY cycle operation and 
recover from the trap provided timing is not critical (e.g. 
BLKO or BLKI to magtape or dectape might get data late in- 
dications). However, a pager trap during a PI cycle should 
never occur and is a disaster so recovery is impossible. The 
running program can be continued after such a trap by JRSTF 
@€777573 as in the sample restart program. The indirect address 
sequence bit is used to distinguish data reads of non-existent 
memory from indirect addressing reads of non-existent memory. 
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In the former case, the software may wish to create a "new 
memory page" and proceed, but in the latter case, a prog- 
ramming error has been made. 


Another interesting feature of the pager is the monitor 
after~-loading trap. All other directed traps take place 

at the beginning of the self-loading sequence, before any 
associative register has been loaded with mapping information 
for the new page, but the after-loading trap takes place at 
completion of the self-loading sequence. This enables the 
Monitor to perform statistics-taking operations for specified 
pages each time one is loaded into an associative register. 


4 
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TRAP STATUS WORD 


g 89 19 


Effective Address of Request 
EM (Exec Mode) 
E (Execute request) 
W (Write request ) 
R (Read request ) 
I (Indirect address sequence in progress) 
PI (Priority interrupt cycle in progress ) 


KEY (KEY cycle in progress--console Examine, 
XCT, or deposit switch pushed) 


Non-EX=]MEM 


Parity Error 
Figure 19-9 
Bits @-8, trap cause are decoded as follows: Bits @ and 1 


define one of four groups each defined below: 


Group @: TSR GY, 1 = 99 


Bit Meaning if ON 
e AGE = G$X 
3 AGE = 92x as read from 
4 AGE = Q4x Cese Ts 
5 AGE = 96X 
6 Monitor After-Loading A.R. trap 
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Group 1: TSR 9, 1 = @1 


Bit Meaning if on 
3 Shared not in core 
4 page table not in core (p.t.2) 
5 2nd indirect, private not in core (p.t.3) 
6 Indirect shared not in core (p.t.2 or p.t. 3) 
7 Indirect page table not in core (p.t.3) 
8 Excessive Indirect pointers (>2) 


Group 2: TSRGY,1= 19 


Bit Meaning if on 
2 Private Not in core 
3 Write copy trap (bit 9 in P.T.) 
m User trap (bit 8 in P.T.) 
5 Access trap (P.T. bit 12 = @ or bits 1f-11=3) 
6 Illegal Read or Execute 
7 Illegal Write 
8 Address Limit Register Violation or P.T. bits 


%,1=3 (illegal format) 


Group 3: TSR Y, 1 = 11 


Bit Meaning if on 
2 Private Not in core 
3 Write copy trap (bit 9 in P.T.) 
i 4 User trap (bit 8 in P.T.) 
5 Access trap (P.T. bit 12 = @ or bits 19-11=3) 
6 Illegal Read or Execute 
t Illegal Write 
8 Address Limit Register Violation or P.T. bits 


G,1=3 (illegal format) 
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10.7 Controlling the Pager via I/O Buss CONO's 


The IOB reset pulse generated by the APR causes the pager 
to completely clear itself. In the cleared state no map- 
ping is performed by the pager and all memory requests 
are passed unchanged to the memory buss. The pager is 
assigned device mnemonic PGR (device number 24) and int- 
erprets the three low bits of CONO PGR, X as described 
below. Other bits of the CONO are ignored. 


CONO PGR, @ Clears all associative registers 
and reloads the Monitor and User 
mode base registers and Address 
Limit Register from location 71 
and the Core Status age and process 
use registers from location 72. 
(see Figure 10-10) 


CONO PGR, 1 Clears all associative registers 
mapping EXEC mode pages. 


CONO PGR, 2 Clears the associative register 
mapping the page addressed by the 
next write (or read-modify-write) 
memory reference. The Pager op- 
erates in the normal manner both 
before and after this write ref- 
erence but does not complete the 
write operation. 


Note that because a priority interrupt may occur between the 
execution of this CONO and the following write instruction, 
it is normally required to do the following: 


CONO PI, 4¢@ 3TURN OFF PI SYSTEM 


CONO PGR, 2 s;CLEAR PAGE OF NEXT WRITE 
MOVEM PAGE*199@  ;CLEAR PAGE 
CONO PI, 299 ;TURN PI SYSTEM BACK ON 
CONO PGR, 3 Clears all associative registers 
mapping USER mode pages 
CONO PGR, 4 Turns off all mapping, leaving base 
registers and associative registers 
unchanged 


CONO PGR, 5 is equivalent to CONO PGR, 4 
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CONO PGR, 6 Turns off mapping for resident 
monitor (virtual addresses 
29-77777.) and turns on USER 
mode mapping and mapping of 
EXEC space ce - 777777 


CONO PGR, 7 Turns on mapping for all address 
28, - T7777T7. for both EXEC mode 
and USER modé references 
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CONO PGR, @ causes the Pager to reload its 
main registers as follows: 


1. Read absolute location 71g. (171, if second APR), 
interpreted as below. 


34 67 22 23 24 25 
‘alae tee ee 


MBR ys Base 
Register) Location 
of the Process Sto- 
rage Block. 


AC Base 
Register 


UBR (User Mode Base Register) 
The location of the User Mode 
page table. 


Q2P = No restriction 
ALR (Address Limit Register) aa fz ee dapat ents 
LimitS Legal USER mode virtual } 974 = ggx sraicitcr ieee 
addresses to the first 16K, gg = 64K ici iec 
32K, 48K, 64K, 89K, 96K, eed _ 48 restriction 
112k. 191 = K restriction 
119 = 32K restriction 
111 = 16K restriction 
2. Read location 729 (172. if second APR) 
g 8 9 1g 35 


26 bits 


PUR (Process Use Register) 


Not Used 
AGER (AGE Register) 


Figure 19-9 


Initializing the Pager For Running a New Process 
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Glossary 


A.G.E.R. 
A.L.R. 
A.P.R. 
A.R. 
C.S.T. 
M.B.R. 
PGR 
P.5.B. 
Pa T's 
P.T.N. 
P.U.R. 
R.C.A. 
S.P.N. 
Oe Bans 


U.B.R. 


AGE Register 

Address Limit Register 
Arithmetic PRocessor (KA1) 
Associative Register 
Core Status Table 
Monitor Base Register 
PaGeR device mnemonic 
Process Storage Block 
Page Table 

Page Table Number 
Process Use Register 
Real Core Address 
Shared Page Number 
Special Pages Table 


User Mode Base Register 
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I. INTRODUCTION 


The BBN Pager Model 701 is a device available to research 
PDP-10 users from Bolt Beranek and Newman Inc. for changing 
the memory mapping mechanism of the PDP-10. In conjunction 
with a set of modifications to the DEC PDP-10 arithmetic 
processor (the KAl10), the BBN Pager allows paging of core 
memory, that is individual relocation of each 512 word page 
of the machine's address space. 


II. ADVANTAGES OF PAGING 


There are a number of advantages to the entire computer 
system when core memory is paged. 


Efficient Use of Core Memory 


One advantage of paging is that core memory is used more 
efficiently. Pieces (i.e. pages) of programs may be 
scattered anywhere in real core and the BBN pager relo- 
cates each page to provide a contiguous "virtual memory" 
for the user. Thus, the system no longer has to worry 
about collecting "holes" in core memory (as is required 
by the current PDP-10 dual relocation hardware) in order 
to fit programs in a contiguous area of real core. 


Virtual Memory Increases the Effective Size of Real Core 


Another advantage of paging is that a program can run which 
would physically take more core than the real core available 
in the system. This concept is called "virtual memory". 
Only pages that are needed at the moment must be in core. 
When new pages which are not in core are requested they can 
be swapped in from the drum and the program can then con- 
tinue execution. Running partially loaded programs can 
substantially increase core memory efficiency. 


Access Protection on a Page Basis 


Another feature of the pager is the ability to provide 
separate access protection for each 512 word page in the 
address space. Independent Read, Write, and Execute pro- 
tections are provided. 


III. PARTICULAR ADVANTAGES OF TEE BBN PAGER MODEL 701 
The Core Status Table 


The BBN pager maintains a core status table which keeps 
records of the activity of the pages in core memory. The 
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pager notes when a page has been used, which processes 
have used that page, how long that page has been in 
core, and whether or not the page has been written into. 


High Quality Engineering 


The pager is constructed by machine wire wrapping and is 
made up primarily of standard DEC M-series modules, except 
for the BBN designed associative register card. Good 
engineering practice has been observed throughout the 
implementation of the pager. For ease in maintenance 

and software debugging, tndicator lights are used on every 
control flip-flop and all critical levels in the pager. 
Also, the pager has a single stepping feature which 
enables one to step through or loop on each hardware 
"subroutine" of the pager cycle. In addition, the wire 
list for the pager has been carefully processed by 
computer programs to assure that no signal overloads 
exist, etc. The pager is also isolated from the memory 
buss during power up and down sequencing. 


Software Support 


The BBN pager has a complete set of diagnostic support 
and time sharing support software. The BBN TENEX time 
sharing system was explicitly designed for use with the 
BBN pager. 


Compatibility with DEC Software 


Modifications to the KA10 have been made in such a way 
that the hardware will continue to run in a so-called 

transparent mode if desired. In this transparent mode 
all of the DEC diagnostics will run and the DEC 10/50 

system will also run. 


IV. BRIEF TECHNICAL DESCRIPTION OF BBN PAGER 


The paging mechanism involves the "association" of the 

9 high order address bits from the KA10O with the contents 
of a set of associative registers. If a match is found, 
the register which contained the match also contains 11 
"real" high order core address bits. (The reason for 11 
bits is to permit up to 1 million words of real core to 
be referenced by the KA10). If no match is found, ref- 
erence is made to a 512 word "page table" in real core 
memory. The word in this page table which is referenced 
is determined by a dispatch based on the original 9 high 


Pais ee 
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order address bits. In the simple case of a private page 
which is in core, the 11 high order address bits are found 
in this word and are automatically loaded into an as- 
sociative register by the pager. There are 3 other cases: 


a. The page is not in core or is non- 
existent in which case a page fault 
(trap) will occur. 


b. The page is shared-~in which case a 
reference is made to another table 
in core to find out where the page 
is really located. 


ec. The page indirectly points to an 
entry in another page table. 


The pager maps both the user's address space and the mon~ 
itor's address space separately. {The full technical 
ore details of the memory mapping mechanism are described in 
details a forthcoming document <] One of the particular advantages 
of our mapping implementation is that the real core 
address of a page (even a shared page) is kept in one 
(and only one) place in the system! 


V. PRICE, DELIVERY, AND OPTIONS 


BBN will supply a fully assembled and checked out pager 
for $50K*, F.O.B., Cambridge, Mass. The pager will be 
checked out on a PDP-10 at BBN, Cambridge, Mass. and will 
undergo an 8 hour reliability test at BBN which the cust- 
omer may witness. Payment terms are 30 days after ac- 
ceptance at BBN, Cambridge. Delivery is 6 to 8 months 
ARO,* ; 


Included with the pager are a complete set of pager prints, 
pager wire list, and the pager diagnostic (symbolic and 
binary) on a DECTAPE. Also included are a package of print 
updates and a set of instructions for the necessary wiring 
changes and module additions which must be made to the KA10 
to accomodate the BBN pager. Contact Ted Strollo for 
details on assistance from BBN on the KA10 modifications. 


Associative Registers 


The BBN pager is normally configured with 16 associative 
registers. The pager will function with 1 to 54 associative 


*Priee and Delivery quotes are subject to change. 


oe 
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registers but if you ever intend to go beyond 16 registers, 
let us know with yourorder! (A larger power supply is needed). 
The number 16 is reasonable for most use of the TENEX 

system. Installations which will be running many user 
programs with large "working sets" (e.g. LISP) will operate 
more efficiently with more associative registers. These 
registers are available at approximately $250 per register 
from BBN. Such registers are added in the field by simply 
plugging them in. 


VI. CONDITIONS OF PAGER SALE 


The KA1O processor mods for the BBN pager have been engine- 
ered to be compatible with KA10's which have up to and 
including ECO #KA10-00060 installed in the machine. BBN 
cannot take responsibility for keeping the processor mods 
compatible with any future DEC modifications of the KAI10,. 
It is envisioned that there will be very few modifications 
to the KA10 in the future since DEC is busily working on 
new machines and most of the bugs and problems with the 
KA10 have been solved. (We have confirmed that no KA10 
ECO's are in progress or envisioned by DEC personnel). If, 
of course, a major problem is found with the KA10 which 

is fixed by a DEC ECO, BBN will make every effort to find 
a way to make its modifications compatible with the ECO or 
vice versa. When we find this possible we will distribute 
these changes to our customers. 


The BBN KA10 processor modifications assume the KA10 wiring 
runs are exactly the same as in BBN's two KA10's. This 
means that the basic KA10 wiring runs as well as all ECO's 
must not have been changed by either DEC or customer person-= 
nel. If there have been any deviations, our add/delete 
lists cannot be followed literally to achieve the correct 
results. In order to help those who may have deviated, we 
have included the mnemonics of signals being added and 
deleted with our processor modifications. 


It has been our experience at BBN that DEC will continue 
to maintain a KA1O with the BBN processor mods installed. 


The customer is responsible for obtaining the memory buss 
cable to connect the pager to the memory buss connection 

of the KA10. Two special additional cables to connect the 
KA10 to the pager are provided by BBN (length to be specified 
by customer with order and not to exceed 30 feet). 


BBN will distribute documentation on pager ECO's (should any 
be issued) to our customers. 


ln 
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VII TENEX SOFTWARE DISTRIBUTION 


The TENEX software will be available to research PDP-10 users 
under a special licensing arrangment (detailed in a forth- 
coming document). Those customers who buy the BBN Pager 

Model 701 are entitled to a copy of the TENEX software package 
at the price of reproduction. Those research PDP-10 users 

who are not interested in buying the BBN Pager Model 701 

but would like a copy of the TENEX software may obtain the 
TENEX software package for a licensing fee of $15K plus 

the price of reproduction. 


Because of variations in customer equipment configurations, 
this TENEX system software will in most cases, require some 
software modifications to work on the customer's PDP-10 
installation. BBN will be able to »srovide assistance with 
these modifications; contact Ted Strollo for details. 


Our customers will also be included on all public distri- 
butions of TENEX software modifications, improvements, and 
bug fixes which will be distributed for the price of repro- 
duction. 
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410. ARITHMETIC PROCESSOR PAGING 


10.1 Introduction 


BBN is designing an interface between the KA-10 arithmetic 
processor and core memory which we call the Pager. This 
device receives from the APR over a standard memory buss 
execute, read, write, and read~modify-write requests. It 

then maps any incoming virtual address into an appropriate 
real core address (provided the request is legal) and passes 
the request to the memory modules over another standard memory 
buss. The mapping requires about 19@ manoseconds. 


The paging hardware performs the following functions: 


(41) Independently maps each 512-word block (or page) 
of the 262,144-word virtual address space into an 
absolute core location, or, if the block is not 
currently in core, traps to a core managing 
program. 


(2) Provides independent protection for each 512-word 
page in the read, write, and execute modes. 


(3) Records statistics in a Core Status Table which 


ut TO the core mancecmeny prosrom. 

The principal stvanenas of paging over the current dual- 
protect~—and-relocate scheme incorporated in the KA-10 is 

that each process is provided with a large, constant 
262,144-word virtual machine, yet reauires only those pages 
which are referenced during an interaction to be in core. 
This can significantly reduce the core memory requirements of 
running programs. 


10.2 Mapping 


It is presently impractical to keep mapping information for 
all 512 pages of a virtual address space in hardware because 
of the quantity of hardware required. For this reason, a 

' limited number (16 originally, expandable to 32) of asso- 
eilative hardware registers are employed and the mapping 
information is kept in 512-word Page Tables in core memory. 
The manner in which virtual addresses are HeaePed into real 
addresses is shown in i 10-1. a 
Whenever a page not’ mapped by the associative registers is 
referenced, the pager initiates a loading sequence (requiring 
about three memory cycles) during which the appropriate page 
table entry is referenced and an associative register loaded 
with the required mapping information. Associative registers 
are reloaded in a round-robin fashion. We hold the theory 
that a program's memory references will be sufficiently 
"collected" that 16 mapping registers are enough to prevent 
too frequent reloading. > 
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As shown in Figure 1-2, which page table is referenced 
during the loading sequence depends upon the memory re- 
quest. There is one page table for user mode requests 
and three possible partial page tables for monitor mode 
requests. The locations of the monitor mode page tables 
are as follows: 


Optional Map 3926 3 to 3977, 


(Not used unless Resident 
Monitor Mapping is turned on)! 


First APR's Map 3128 2 to 31778 
Absolute locations 
Second APR's Map 37288 to 37778 


Common Map 3228, to 35772 J ‘ 
Private Map . 606, to 777g, of the Process Storage Block 


'The locations of the user mode page table and of the pro- 
cesS state page are loaded into the pager when processes 
are switched, as described later. 


18.3 Controlling the Pager via I/O Buss CONO's 


The TOR reset Onise roenerated by the AaPR causes The wna 
ry pa 


Ove s wee waaw en 


to completely clear itself. In the cleared state no 
mapping is performed by the pager and all memory requests 
are passed unchanged to the memory buss. The pager is 
assigned device number 24 and interprets the three low 
bits of CONO°24, X as described below. Other bits of the 
CONO are ignored. 


CONO 24,6 Clears all associative registers and 
reloads the Monitor and User mode base 
registers and Address Limit Register 
from location 71 and the Core Status 

age and process registers from location 
= , 576 of the (newly mapped? Process Storage 
Block. 


CONO 24,1 Clears all associative registers map- 
: ping monitor mode pages. 
CONOQ 24,2 Clears the associative register map- 
ping the page addressed by the next 
ele. 5 write (or read-modify-write) memory 
reference. The Pager operates in the 
normal manner both before and after 
this write reference but does not 
complete the write operation. 


282 


711111 ¢ 


User Mode | 


Although processes 
may operate in 
environments as 
large as 256 K, 
the Upper Bound 
Register may be 
set to exclude 
all memory refer 
ences above 16, 
32, 48, 64, 80, 
96, or 112 K. 
Processes not requiring 
a large virtual address 
Space may achieve econom 
by using the Upper Bound 
Register and merging the 
User Mode page table int 
the top of the Process 
Storage Block. The num- 
ber of overhead pages re-| 
quired is i 


.2 = 
then reduced . } 


' from two to one. 


Monitor Mode 


32 K Unmapped area * 

Absolute addresses 
Mapped individuall 
per Processor 


32 K 


Mapped commonly 
for all processes , 
and all processors, 
Non-resident in-~ 
formation in the 
Exee and Monitor 

is referenced via 
this map. The map 
itself is in the 
unmapped core area. 
between 32008 and 
357 


78: 
Mapped privately 


per process 


128 K 


bie 


Figure 19-2 
Mapping of Virtual Addresses 


> 
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*Optionally mapped by locations 3828 to 3877 


CONO 24,8 ' eauses the Pager to reload its main registers. 


as follows: 


1. Read absolute location 713; (174, if second APR),. 
interpreted as below. 


g 17 35 


XXX 114 bits | | 


t . 


MBR (Monitor Base Register) 
Location of the Process 
State Page. 


UBR (User Mode Base Register) 
The location of the User Mode 


page table. G0B = No restriction 
ALR (Address Limit Register) at eK retin 
Limits legal virtual addresses G11 = 86K restriction 
to the first 16K, 32K, 48K, 64K, 10% = 64K restriction 
82K, 96K, or 112K. 161 = 48K restriction 
118 = 32K restriction 

4ii = i6K restriction 


2. Read location (MBR) 278g. 


AGER (AGE Register). = ra | se 


‘Figure 1-3 


Initializing the Pager For a New Process 


PN Indirect Page 


P.T. Address 


Table : 
"| q 
| Some , 
: Address : Address : 
LEKI SSR E : - Indirect Page : 
[ (Alternatively, i 
(this could be a . 
00 Address | |shared pointer; | | 
: amar: ‘or a 2nd indirect 
| ipointer, but more. } 
ERS aE EEC Shared Pointer | ithan two indi- 
; Table | lrects will cause bd 
User Mode a trap. > 
Page Table | “3 
O 
: 377 siece aaa a 
22-Bit Address Field ape rage ee Hi 
Shared Page 4 
“y 
i 


if any of these bits is # @ a not-in-core trap will occur 


= Right most 11 bits are a core page number 
A1XXX = Right most 21 bits are a Bryant disc address 
= Right most 14 bits are a Bryant drum address 


Other codings may be used depending upon the devices on the system. 
* 


Origin of Shared Pointer Table is at location 20,000, 
The hardware permits a length of up to 20,0003. 


1 


Figure 19 - 5 


Private, Shared, and Indirect Mapping 
By the Paging Hardware oe 
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CORE STATUS 


TABLE 
* 
Absolute DAS/NIN/ 
Page No. 


10000, ee | ™ = 


Core Status Table Entry _ 


o/ 8 9 10 a cssens on es Sipiadh idence last 6 BO 
9 Bits 26 Bits | 
i BCS Sete erate teehee MERE T OCS Mente Steen Row eiahs 
modification’ 
9 Bixe 26 j Bits NS oe 
0 8 nt STO REE OAS ERLE EL IE EERE ES Matt Ae OY eee 35 } 
AGER PUR 


1. Bits @ - 8 of AGER replace Bits @ - 8 of CST entry. 


2. Bits 18 - 35 are "ORed" into Bits 18 - 35 of 
CST entry. 


3. Write request level is "ORed" into Bit 9 of 
the CST entry (if the write is permitted). 


Figure 18 - 6 


. : . . 7 & 
- -. Pager References to the Core Status Table 


If no trap condition occurs during self-loading, an asso- 
clative register is loaded with the required mapping in- 
formation and the pager proceeds. Note, however, that 

the write permission bit in an associative register is set 
only when both the modification bit in the Core Status 
Table and the write permit bit in the page table entry: 
are sev. 


18.5 Pager Traps 


A paging trap will occur whenever one of the following 
events happens: 


4. The trap bits in the process page table force 
a trap. 


2. The addressed page (or indirecting page table) : 
is not in core. 


3. An illegal condition is detected. 


#, The Core Status Table entry for an addressed page 
contains an age with the three highest bits = g 
(meaning that the core manager is controlling 
the page). 


When one of the above conditions happens, the pager first — 
stores the cause and location of the trap into the Process Sto= 
rage block at location 571). The format of this word is 


ohsa tw es cure 14s. ts Than If f#ha ADR overati An an nro; 
S2cwn an 2 4OH4Le ay” 2s tag 2a Vaid ARR Sawer we 


gress was a write, it stores the data into location 572 
of the state page. Finally, it forces the APR to execute 
absolute location 72% (178. if second APR). Location 7B 9 
shoulda contain a gsy8 instruction to a trap routine. 


The arrangement of the Trap Cause field was chosen so that 
decoding of the cause could be easily accomplished by the 
JFFO instruction. 


To restart a process which was terminated by a pager trap, 
the following information is of value: 


4. The program counter (PC) saved by the JSYS at 
location 7B is correct. 


2. If the read or execute bits in 571, of the state 
page are set, restart is completed by performing 
a JRSTF @ through the PC word saved by the JSYS 

‘at location 7B (178). 


-3. If the read bit is not set but the write bit is 

set in 571 the data in 572, must be written 
into the addness of 571, before returning control 
to the process via gRST# Va8 
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A sample program to restart a process which was terminated 
by a paging trap is given below: 


CONO 24,2 ;LOAD PAGER WITH NEW BASE REGISTERS 
;UPPER BOUND REGISTER, AND DUMP REGISTER 
MOVE 1,777571 3;GET TRAP STATUS WORD 2 4 


SETZM 777571 3;CLEAR TRAP STATUS FOR NEXT TIME 

TLNE 1,12 ;SKIP IF NEITHER READ NOR EXECUT 
;BITS SET 

JRST BEGIN 

MOVE 777572 - ;GET DATA WORD 

TLNE 1,1 ;SKIP IF USER MODE 

JRST MONWR } 

UMOVEM (1) ;COMPLETE USER MODE WRITE 

BEGIN: HRLZI 17,777520 ;RESTORE AC's FOR THE PROCESS 
BLT 17,17 


JRSTF @777573 sRESUME PROCESS (JSYS IN LOCATION Be 
sSAVES THE FLAGS AND PC IN 777573). . 
MONWR: MOVEM (1) sCOMPLETE MONITOR MODE WRITE 
JRST BEGIN : 


In Figure 1-7 the function of the PI cycle, Key Cycle, and 
Indirect Address Sequence bits may not be clear. The reason 
for the PI cycle and KEY cycle bits is to distinguish traps 
‘of the running program from PI and KEY cycle traps (KEY 
cycles occur when the console EXAMINE, DEPOSIT, or XCT 
switches are pushed). The Trap Status Word in Figure if-7 
contains sufficient information to simulate a KEY cycle 
operation and recover from the trap provided timing is not: 
critical (e.g., BLKO or BLKI to magtape or dectape might miss 
latency). However, a pager trap during a PI cycle is a 
disaster and recovery is impossible. The running program can 
be continued after such a trap by JRSTF @777573 as in the sam- 
ple restart program. The indirect address sequence bit is 
used to distinguish data reads of non-existent memory from 
indirect addressing reads of non-existent memory. In the 
former case, the software may wish to create new memory and 
proceed, but in the latter case, a programming error has 

been made. 


Another interesting feature of the pager is the monitor 
after-loading trap. All other directed traps take place at 
the beginning of the self~loading sequence, before any 
associative register has been loaded with mapping information 
for the new page, but the after-loading trap takes place at 
completion of the self-loading sequence. This enables the 
Monitor to perform statistics-taking operations for specified 
pages each time one is loaded into an associative register. 
Such statistics may be very useful in evaluating core 
management strategies and in evaluating the performance of 
the pager. . 
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1g.6 Core Management Philosophy 


Core management for processes with large virtual address 
spaces is a significant problem. To minimize difficulties 
we have designed into the Pager several features (Figure 


18-6). 


(1) 


(2) 


(3) 


(4) 


Recording modification 


Because a write request will set the modified bit 
in the Core Status Table, core-to-drum swaps need 
be performed only for pages with this bit set. 


Identifying Processes using a page 


By loading the process use register (PUR with a 
bit identifying the current process the Core 
Status Table entry for each page will contain a 
record of the processes which have used each page. 
The core management program can then discriminate 
pages in use by active processes from those which 
were used by processes now inactive. 


Marking time-of-last-reference 


When a large process is compute bound, its "working 


esi radio h 
sc will frequengisy c LeanssS with eae By 


periodically incrementing the age register, the 


eore manager can look at the ®re Status Table and 


for each process distinguish recently referenced 
pages from ones not referenced for a long time. 
The latter are likely to be outside current 
working sets and are good candidates for replace- 
ment by new pages. 


Provide for dual-processor operation 


Because one APR may be computing for a process, 
while the other APR is tampering with the Core 
Status Table, we have included a special check in 
the paging hardware for ages less than 28,. When 
the software is about to examine sme entry in the 
Core Status Table, it may EXCH a word with the 
Jeft-most three bits = @ for the Core Status Table 
entry. This will prevent the other APR from 
inadvertently loading this page during the 
examination... 


